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ABSTRACT 

The widespread use of standardized tests and the high 
stakes decisions made because of their scores are facts that cauinot 
be ignored. It can be argued, therefore, that assessment literacy 
should be included in the training of teachers and administrators* To 
determine the extent of selected assessment knowledge among 
preservice and inservice teachers a survey of test-taXlng 
considerations, test-administration procedures, and test-wiseness 
strategies was sent to 130 preservice and 119 inservice teachers who 
were enrolled in coursework at a large mldwestern university. 
One-third of the preservice and 10 percent of the inservice teachers 
had not taken any tests and measurements courses. Results suggest 
the.t both groups could benefit from additional knowledge about 
standardized test administration, preparation of students to take 
tests, and n^ing Informed decisions about test scores. Assessment 
literacy could be improved in courses that emphasizet (1) differences 
between standardized and teacher-made tests; (2) the importance of 
following administration procedures to ensure score validity; (3) 
general test-wlseness skills that may be taught to improve general 
testing performance; and <4) unethical practices including 
instruction in specific test content, using actual items from the 
test. At least one tests and measurements course is recommended in 
order to complete the teacher education program. (LL) 
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Assessment Literacy: Perceptions of Preservice and 
Inservice Teachers fi.^arding Conaderations 
of Standardized Testing Procedures 

Siandanlizcd testing has become a pervasive tool in our educational community since its 
inception in the cariy 1900s (VanLeirebuiB, 1991). An enomous amount of testing occurs in our 
schools; rough estimates suggest that a large percoitagc of stu<tents in the United States receive 
more than 2,000 test items each year (Tiemcy. Carter. & Desai, 1991). TypicaUy. a student may 
spend from two to six houre each year taking tests throughout the elementary and high school 
ycare. Special education ^cnts undergo many more hours of testing. These estimates do not 
include tests which accompany textbooks, local instmctional tests, and teacher-made tests (Wigdor 
& Gaidner, 1982). 

Smith (1991) investigated the role of external, or mandated testing, on elcmentaiy schools. 
Such testing programs were found to reduce the time available for instruction by 100 hours per 
school year. External testing also reduced the school year by tiiree to four weeks when the time 
required for Uie actual testing, in preparing students to take the tests, and recovering rrom the 
testing situation were taken into consideration. 

Most school systems use standardized tests to measure academic achievement. National 
goals by tiie year 2000 include: preparedi«!ss to learn upon school entry; increased competency at 
Uic end of grades 4. 8, and 12; 90% high school graduation rate; and adult literacy. The 
achievement of these goals relics upon standardized testing to "prove" that they have been reached. 
Such tests enjoy tiie support of many public agencies, taxpayers, administrators, school boards, and 
teachers. (Wigdor & Gardner, 1982). 

Over tiic past several years, educators and the public alike have become aware and 
accepting of the importance of educational outcomes and high achievement standards (Stiggins, 
1991). Academic success at tiic national, state, and individual level is cqMated with high test 
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scares; moreover, important instructional and policy deciacms are often based on ^udou 
achievement as measured by ti^se scones. Studoits benefit if these d^sions are based m sound 
data and an understanding of standardize^ mcasimanenl. 

Assessmoit liters involve the critical analysis of data and infonn€d omsumerism 
(Stiggins. 1991). Johns and Davis (1991) surveyed preservice and inservice teachers to detcimine 
their knowledge about test taking and ethical issues inherent in test-wiseness programs. Results 
indicated that laige numbers of both groups did not fully uiKlerstand tiK impoitance of 
standardized testing pnxsdures aral that over (n^-third of both (»i^rvice ami inservice teachers 
weie unclear about tire ethics of test-wiseness |»ograms as contrasted to actual te^hing to the te^ 

Brown (1989) found a devotion to and misunderstaiKling of standardized toting procedures 
and scones in a survey reviewing scmie state and local teeing guidelii^. Moft educators 
detennine academic i»ogress on the l»sis of somcs on ccnnmenrial standaniized nonn-nefen»K:ed 
tests and consider such tests valid indicators of student and school adiievement Also, most of the 
educators surveyed believed that thinking, creativity, and problem-solving cannot be measured 
(Brown. 1989). 

Educators must understand starolanlized test data in rontext to make informed use of the 
resultant sampling of student academic behaviors. The widespread use of oandanlized tests aiKi 
the current national climate regarding te^ng dictate tlKir exigence for some time to come at the 
state and national levels. The pervasiveness of standardize! tests and the high-^es decisions 
made as 3 result of their scores cannot be overstated. Assessment literacy on the part of teachers 
and educators is imperative due to our nation's devotion to quantitative outcomes. 

Assessment literacy diould be included in the training of teachers and administratois. The 
use of standardized tests has grown in the past several years; the training of school personnel 
should reflect a similar growth pattern. Teacher education should require practical coursewoik 
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related to basic concepts of sftandaidized testing: general test-taking considerations, test-taking 
procedures, and tesi-wiseness strategies. How mudi kiM>wledge about standardized te^ do 
preservicc and inservic^ teachen have? A survey of test-taking considenuimis, test-admini^ralion 
procedunes, and test-witness strategies was ad^ned from an eartier study by Johns and Davis 
(1991) to determine the extent of selected assessment knowledge among presendcc and inservice 
teachers. 

Method 

Subjects 

A total of 249 subjects participated in this study: 130 (Meservice teactwrs and 1 19 
inservice teachers. The 1!^ prcscrvicc teachers were enrolled in coursewoik at a large midwesiem 
university. None of these subjects had teaching experience on a contractual basis; 84% were 
undeigraduates pursuing a bachelor's degree, 9% had earned a bachelor's degree, 5% were 
completing work toward a master's degree, and 2% omitted this item on the survey. Nearly 
three-fouiths of the total group was woiking on a degree in elementary education; the remaning 
OIK- fourth were completing a degree in special education. 

The 119 inservice teachers were attending graduate courses at the same large mid western 
university. Two-tWnds of this group were elanentary tcacters. Of the nunaining one-third, 17% 
were special education teachers, 8% were soxsidary leaders, and 6% were reading teacl^rs. 
About two-thirds of this group had complete a bachelor's degree; the remaining one-third held a 
master's degree plus additional hours. The teaching experience of this group ranged from 
om year to more than 16 years. The majority of theye teachers, about iwo-thirds, had taught from 
one to five years, and about 15% of the inservice teachers had taught 16 or more years. 

About one-third of the preservice group had not had a test and measurments course; 
nearly two-thirds had taken one such class. Approximately 10% of the inservice group h^l never 
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taken a test ami measunements course; hoM^cr, over 90% taken one or more of ll^e classes. 
Survey 

An 1 1 -item survey included statements about staiKlaidizol test-taking proc^unes and 
test-wiseness programs. It was adapted from the earlier survey by Johns and Davis (1991) and 
administered to the preservice and inservice teachers in their university classes. Subjects 
were asked to mark tlie response that most i^ariy matct^ tl^r beliefs regarding test-taking. 
Response choices were on a contiraium ranging as follows: "strongly agree," "agree," "imdedded," 
"disagree." or "strongly disagree." 

Results 

The questions in the 1 1 -item survey were rearranged into the following three main 
categories for this report: gowral te^-taking ooisiderations, standardize test-administration 
procedures, and test-wisoiess. The results are discussed as they relate to eadi category. Total 
percentages of the results may range from 99 to 101 due to rouraltng. 
General Te^-Taking Conaderations 

Table 1 contains the results to tire survey items tixal question^ whether or noi the subjects 
agreed that midcnts should be inforaicd they would be taking a test arel what the purpose of the 
test would be. Results are present^ separately for preservice and inservice teachers. 

In both groups, inservice and 'ireservice, ai least 90% agreed or strongly agreed with these 
statements. Gronlund (1985) and Anasiasi (1988) note that the test-taker should be informed in 
advance that a lest will be given, what the purpose of \he test will be, and what content may be 
covered. Respondents appeared to be consistent with the literature in this area. 
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Table 1 

Survey Results for Gei^ral Taking Considerations 







Percentage of Respoises* 


1 Survey Items 




SA 


A 


U 


O 


SD 




1. Stu^ms dKMikl be infonned a few 
days in advarxe that they will be 
tiddng a te^ 


Inservioe 


79 


17 


1 


0 


3 


0 


Pieservice 


76 


18 


2 


3 


1 


1 


2. Test jmrpo^ or intents ^lould be 
ex{dained to studoits before ti% testing 
P date. 


Inservice 


85 


13 


2 


0 


0 


0 


Pnwervice 


78 


18 


2 


0 


0 


1 



*stn>ngly agree, agree, urulecided. disagn^, stnmgly diss^rce, omit 
Standardized Test-Administration Procedures 



TaWe 2 presents respcNses to the dace statements fiwn tte survey used to determine tlw 
degree to which fwcscrvice and iracrvic* aibjccts understood standardized testing procedures. 

Responses to items 3, 4, and 5 vari^ considerably. Almost wie-founh to one-third of the 
respoises by both inservice and prescrvice subjects were undecided. Frran 40% to 58% of both 
groups strongly agreed or agreed with ttx si^ed procolures for giving tests; around 20% to 30% 
of both groups disagree! or sux)ngly disagreed. 

According to Gronlund (1985), standardized tests should not be given in the same manner 
as teacher-made tests. Approximately 40% of both prescrvice and inservice teachers, however, 
believed that the two types of tests should be administered in a similar manner. 

Standardization requires that tlw same directions be read to all students; thus, reading 
directly from the manual for such a test is vital. Nevertheless, approximately 20% of the inservice 
teachers and 26% of the prescrvice tcachere disagreed with this statement. 
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TaWc 2 



Survey Results for Test-Administration Procedures 



— — ■ — " 

Survey Itsms 


Group 


Percentage of Resp(Ni$es* 


SA 


A 


U 


D 


SD 


O 


1 3. Standardized tests should be given in 


Inservice 


17 


23 


30 


24 


6 


0 


1 the same m muter as teacher-made tests. 


Prcscrvicc 


14 


28 


35 


18 


3 


1 


2. Teadwrs ^Kmld read t>» din^cms of 
staiKlaidized t^ts directly out of tlw 
teadier's manual. 


Inservice 


25 


33 


23 


13 


6 


n 1 


Prcscrvicc 


18 


25 


30 


21 


5 


1 


S. TeiK:hen ^uld give spcaai assistance 
to poor readers by reading the 
standardized t^ items aioad. 


Inservice 


18 


30 


23 


23 


7 


0 


PrKcrvice 


15 


27 


28 


22 


8 


1 



♦strongly agree, agr%, undecided, disagree, strongly disagree, omit 



Unless directed by the testing manual, items may not be read aloud for poorer readers. 
Only 30% of the inservice and prtservice teachers disagreed or strongly disagreed with the 
statement. Surprisingly, neaily 50% of the inservice teachers agreed with helping poor readers by 
reading items aloud. Responses to this item by both preservice and iro-«rvicc teachers indicate a 
lack of Icnowledge in the area of staiMlardized tesi-adminisiraiion guidelines as promoted by 
assessment experts and the manuals of many standardized tests. 
Test-Wiseness Preparation 

Six Hems from the survey related to tesl-wiseness. Items 6 through 1 1, along with fhe 
responses of inservice and prcscrvicc te^lwrs, are contained in Table 3. 
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TaWe 3 

Survey Results for Tesi-Wiseness Preparation 





Group 


Penrettti^ of Responses* 


1 Survey Items 


SA 


A 


U 


D 


SD 


0 


16. It is ethical to teach lest-wiseness 
1 skills in order to imfHove te^ soor^ 


Inservice 


47 


36 


8 


7 


2 


0 


Preservice 


29 


45 


18 


6 


0 


1 


7. Using class time to teach test taking 
skills can be productive for studoits. 


Inservice 


45 


45 


8 


2 


1 


0 


Preservice 


32 


54 


8 


4 


1 


1 


1 8. Students slKiuld beomie fi^iliar with 
1 the mechanics of a jitandanliz^ test 
before xiuBl toting begins thnm^ 
t)^ use of prance exercises. 


Inservice 


43 


45 


10 


1 


1 


0 


Pre^rvice 


38 


49 


8 


4 


1 


1 


9. Tej^iing stwtents how te^ que^ions 
are om^nicted is a legitimate role of 
the teacher. 


Inservice 


17 


37 


31 


11 


4 


0 


Pre^rvicc 


15 


38 


27 


18 


2 


1 


10. Test-wiseness programs dwuld 

include material from tbi actual tms 
to be taken by studoits. 


In^rvice 


11 


21 


18 


34 


16 


0 


Preservice 


12 


19 


28 


35 


4 


2 


11. Smdents stwuld be instructed in tl% 
subj^ matter of specific standardized 
tests. 


In^rvic^ 


12 


18 


35 


26 


8 


0 


Pre^rvice 


9 


33 


37 


16 


3 


2 



♦strongly agree, agree, undecitiol, disagree, strongly dis^ree, omit 



Items 6 and 7 measured the ethical aspect of teaching test-taking skiUs. About 75% of 
both groups agreed that teaching test-taking skills can be beneficial to the student In the inservice 
group alone, over 80% of the subjects surveyed agreed with such techniques. The preservice 
teachers were slighUy less certain about the ethics of teacliing test-taking skiUs and about 20% 
were undecided. 

Items 8. 9, 10, and 11 of the survey were designed to detemiine if the two groups of 
subjects werc aware of the difference between coaching (aouaUy leaching to the t^) and teaching 
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tcst-wiscncss strategics. Item 8 dealt with t}^ of sam{^ questions to familiarize stiKiems with 
the testing foimat. Anroximately 90% of both gixnips agreed that sampte questions should be 
used to m^e ^udcnts familiar with the actual test Item 9 was concerned with the legitimacy of 
acquainting students with die constnic^km of t^ qu^(»& About 30% of both groups weie 
uncertain about this practice, but slightly more than half of each group agreed that teaching how 
test items are constmcted is a legitimate role of the te^rher. 

Items 10 and 1 1 dealt with teaching specific content material included within staiKlanlized 
tests and resulted in a variety of responses from both the preservice and inserviu teachers. 
Almost 20% of the inscrvicc teachers aiul 30% of the preservice tead»rs were uiKlccidcd about 
whether test-wiscness programs should include actual material from the standardized test to be 
taken by the students. However, about 30% of both groups agreed that such material should be 
included in test-wiscness programs. Approximately 50% of the inscrvice teachers and about 40% 
of ihe preservice teachers were aware that the actual material from starelardizcd tests should not be 
used prior to the testing atuaiion. Over 35% of both groups were undecided as to whether 
students should be instmcted in tte subject matter of specific ^aixlardized iesi&; at least 30% of 
both groups agreed that such content instruction should take place. 

Test-wiscness programs generally include instructing studoits in the mechanics of testing 
and the types of items that comprise a test Taking class lime to instnict students in relaxing and 
responding may help to better their scores as they apply these skills to all content domains. 
Tcst-wiscncss programs are generally considered ethical and beneficial although material from 
actual standanlized tests should not be used in the instruction of test-taking skills (Anastasi, 1988). 
Using acmal test items or specific material from a test will cause the score to become an invalid 
measure, not rcprcsentaiive of the student's actual knowledge (Gronlund, 1985). 
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There is, however, a distinction between tcst-wisei«ss and ooadiing (Ritter & 
Idol-Maestas. 1986). Test-wisoiess is consdered the instniction of test-taking skills that may be 
api^icd to many types and domains of tesUng. Coadiing is instniction in ibe specific coniem 
being measured and it serves to inflate a student's score, not measure »mial achievemera over 
time. Inflated scores arc probaWy ncA true measures of a stiKient*s adiicvcmeni wlrai com{»red to 
the nonning pOfHilation. 

In summary, the pattern of rcspwises to the survey by iM««rvicc and iiwcrvice te£u:tKrs 
was similar for both gwwral test-taking considerations aral test-taking procedures. The general 
pattern of response was different for both groups relating to the ethical considerations of 
tcst-wiseness. Both groufK, preservice and inservioe teachers, offered a large percent^ of 
responses which were inconsistent with the literature and test-taking procedures and test-wisencss 
programs. 

Discussion and Reconin^ndations 

The clevcn-iiem survey used in this study was ^ai^ from an eaiiier audy by Johns and 
Davis (1991) to determine whether prescrviM and insenice teact^rs were kiwwlwlgeaWe about the 
ethical considerations of tcst-wiscncss programs. The overall response patterns arc amilar in both 
studies. Prc»;rvice and inservice teachers could jwofit from additional knowledge about 
standaidized icsl-administration procedures and test-wisencss programs. Requiring at least one test 
and measurements course for the completion of te^hing degree programs would probaUy be 
beneficial in building needed knowledge. Cuncntly, only four states require that prospective 
teachers take at least one tests and measurements course (Hills, 1991), At least one-third of the 
preservice leachere and about 10% of the inservice teachers surveyed in this study had not taken 
any testing c<Mirscs. 
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Educators must have awareness of basic standardized testing procedures. The ethical 
considerations of lest-wiscness as opposed to actual coaching for a specific test must be 
understood in order to maintain the validity and integrity of tests. Standaidized tests arc used at 
all grade levels, in most subject areas, and may d^nnine eligibility of ^oits for special 
education. An awareness of the strengths and limitaticms of these tc^ng locds is essential for all 
educators. Assessment literacy is a component that should be included in the education of :cachers 
and administrators. Because a majority of subjects in the audy indicated that they had taken a test 
and mcasurcmails course, the content in such course might need to be reexamined. 

Mchrens and Kaminski (cited in Hills, 1991) developed a seven-point continuum of cuircnt 
practices used to prepare students to take standardized tests: 

1. general instniction on tie c^jectives of the curriculum, 

2. instruction on test-taking skills, 

3. instruction <m ot:yectives gei^rated by looking at the objectives measured by a 
variety of stand^izol t^ts, 

4. instruction on objectives specifically matching the skills involved in the 
standardized test to be used, 

5. instruction on specifically matched skills in which instruction follows the same 
item forniat as the test questions, 

6. practice on a parallel form of the test to be us^, and 

7. practice on the actual tests to be used (Hills, 1991, p. 544). 

Practices 1 and 2 are typically considci^l ethical and advisable; however, pruclices 6 and 7 are 
highly unethical. Practices 3, 4, and 5, the middle of \bc continuum by Mehrcns and Kaminski, 
detail testing preparation practices which border on the unethical. Respondents to the survey 
covered the entire seven-point continuum. 

Of concern is ti^ evident lack of assesanent literacy from many of the respoiKlents. 
Approximately one-tiiird of both prcservice and inscrvice teachers marked "undecided" for issues 
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related to test-taking pnx^^un^ and tcst-wiscn^ ptograms. At least 45% of all lespondoits 
believed that teachers should give poor readers extra assistaiKe by reading the standardized lest 
items aloud, a practice which would invalidate the teeing results. At least 20% of both pescrvicc 
and inscrvice teachers did not realize that direction should be read aloud directly from the 
manual. Neariy one-third of both groups believed that coadiing, in the form of including actual 
instruction in comcm ma'^rial from the test, is an ethical practice. With the pervasive and 
increasing use of standardly te^ both {^eservice ami inservice teadiers will n^ to increase 
their assessment literacy in order to {Minister starojardized tests coir^tly, prepare sudents to take 
tests, and make informed decisions abcnit test scores. 

Preservicc teachers OMild improve their asse^mem iitenwy within m^hcxls or 
mcaairranent coursework emi^iasizing these principle: 

1. Teacher-made and standardized t^ have differences. 

2. Standardized procedures must be followed to ensure score validity. 

3. General tesl-wisaicss skills may be tought in order to improve general testing 
performance. 

4. Unethical practices iiKliuie instructing in sp^ific test content, using actual items 
from the lest, coaching, and helping ^dents by reding items to them. 

Inservice teachers would bciwfit from attemion to tl»se points as well. Staff (tevelofment 
programs and additional coursework should help to improve the assessmcm literacy of educational 
professionals. Professionals who teach courses in assessment ought to stiKly their outlines to 
ensure that attention is devoted to ethical dimensions of test prq>aration and administration. 

Haladyna, Nolen, and Haas (1991) point out that standardized achievemem test scores have 
become the operational definition for educational achievement. Pressures to raise test scores at all 
costs are great. The result has been what has beai referred to as a pollution of test scores 
(Haladyna, Nolen, & Haas, 1991). Two major practices have contributed to the pollution of 
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staiKlardizcd test scones: how {HiMic »:hools prepare students to take the aandaidizcd test; ami 
nonstandaid practices ^ conditions under which tests are adminiacral (Hal^lyna, Nolen, & 
Haas, 1991, p. 2). The instruction in general test-taking procedures, ethics related to 
standardization pnx«durcs, and tesi-wisencss programs can improve the a^essraent literacy of 
educators and also result in more valid test scores. Without such knowledge, standardized test 
scores become meaningless numbers. 

Stiggins (1991) ncu» a bleak pit^re of assessment literacy of those filling portions in 
educational leadership. Most stales do not require explicit training in assessment as a part of 
teacher certification. Further, wh«i assessment training is offered to teachers, it falls short of 
providing the infonnaiion necessary to produce assesancnt literates. "To complete this picture, 
those trained to become administrators are often trained less well in basic assessment than arc the 
teachers whose work they are supposed to supervise" (Stiggins, 1991, p. 535). 

In order that educators become ^xxl ccmsumers of data testing can provide, the task of 
preparing teachers and administrators to become literate in dealing witii assessmeru issues aixl 
tools becomes critical. The Ume has come to improve and increase assessment literacy. At the 
very least, courscwoilc in assessment slrould deal with areas of concern raised in this report. The 
larger task would be for teachers \hen to reduce the gap between this knowledge and actual 
practice. 
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